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Abstract. Multi-Objective Evolutionary Algorithms (MOEAs) have been 
proved efficient to deal with Multi-objective Optimization Problems (MOPs). 
Until now tens of MOEAs have been proposed. The unified mode would 
provide a more systematic approach to build new MOEAs. Here a new 
model is proposed which includes two sub-models based on two classes 
of different schemas of MOEAs. According to the new model, some rep- 
resentatives algorithms are decomposed and some interesting issues are 
discussed. 
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1 Introduction 

Evolutionary Algorithms are an randomized searching approach based on Dar- 
win's evolutionary theory. They play an important role in many fields such as 
optimization, control, game strategies, machine learning, and engineering design 
etc. 

In 1984, David SchafFer introduced Vector Evaluated Genetic Algorithm 
(VEGA) [IE] to solve Multi-objective Optimization Problems (MOPs). Hence- 
forth, the research on Multi-Objective Evolutionary Algorithms (MOEAs) at- 
tracted more and more researchers. Up to now tens of MOEAs have been pro- 
posed. 

To guide the efforts on MOEAs, some researchers tried to build unified mod- 
els for popular MOEAs. For examples. Macro Laumanns et al.[5] proposed a 
unified model for the Pareto-based and elitist MOEAs in 2000. This model 
can describe most popular famous MOEAs, such as Non-dominated Sorting Ge- 
netic Algorithm II(NSGA-Il2], Strength Pareto Evolutionary Algorithm and its 
improvement(SPEA/SPEA2)|n], Pareto Archived Evolution Strategy (PAES)[B] 
and so on. [7] expressed the schema of MOEAs which employ archive with such 
a formula as follows: 

MOEA = Archive -1- Generator 
But this formula is quite simple. Recently, more and more MOEAs can not 
be accurately described by these models, such as Adaptive Grid Algorithm 
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( AGA) [8] , Rank-Density based Genetic Algorithm (RDGA) ^ , Geometrical Pareto 
Selection ^GPSl flOTTl] and GUIDED [12] etc. 

In this paper, we propose a new model to describe the advanced MOEAs. In 
section 2,the model is introduced . And then SPEA[5j ,AGA^ and GPS .lOTTI] 
are decomposed in section 3 according to this model. Some interesting issues are 
discussed in section 4. In section 5, some conclusions are made. 

2 Introduction to the New Model 

The first MOEA - VEGA - is a non-Pareto algorithm. Subsequently, Goldberg 
D. E. [13] proposed to use Pareto dominance to compute the fitness of the indi- 
viduals based on 'Ranking' method. Subsequent experiments prove that Pareto 
dominance based MOEAs are more efficient than non-Pareto MOEAs. Since the 
work of Zitzler et al.[5], the 'elitism' of MOEAs has been recognized: Elitism of 
MOEAs is especially beneficial in deal with MOPs and the use of elitism can 
speed up the convergence to the Pareto front, the Pareto based MOEAs with 
elitism is more efficient than the MOEAs without elitism. To implement the 
elitism, many MOEAs use a secondary 'elitist' population ,i.e., the archive, to 
store the elite individuals. According to MOEAs' formula, the pseudocode of 
common elitist MOEAs with archive can be depicted as Figure [TJ 

1 initialize the population and archive 

2 evaluate the population 

3 while the termination criterions have not been reached do 

4 generate a solution by the generator 

5 evaluate the new solution 

6 try to update the archive 

7 according to the feedback of archive, try to update the population 

8 end while 

Fig. 1. Pseudocode for Generic MOEAs with Archive 



The pseudocode seemly does not mention the generation gap methods. Ac- 
tually, the generation gap methods can be decomposed into this model, if we see 
the generation number and the replaced parent individuals as the additional pa- 
rameters. Moreover, though Single-Objective Evolutionary Algorithms(SOEAs) 
and MOEAs are very similar, there still are three major differences: 

1. Different to single-objective optimization, the generator of MOEAs may 
crossover some individuals in population with the individuals in population 
or archive 

2. the fitness assignment is more complicated, because it is relative to two 
operators: fitness evaluation for the archive and fitness evaluation for the 
population 
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3. As to the elitism, the SOEAs just keeps only one fittest individual. But in 
MOEAs, the elitism, commonly, the strategy to update the archive is quiet 
complicated. 

In general, the new model can be depicted as Figure [51 




Fig. 2. The Model of Elitism MOEAs with Archive 



In Figure[2l updating the archive would retrieve information from the archive, 
so the link is not drawn in this framework. Moreover, the generator is similar to 
the generating process of SOEA. Actually, except the selection operators, they 
both are same. It can be depicted as Figure [3l 



Population | | Archive 




Offspring 



Fig. 3. The Framework for the Generator 

Secondly, the strategy of updating the archive is different to SOEA and very 
complicated. 

Very many MOEAs employ the ranking-alike operators and the niching-alike 
operators. In such a schema, ranking-alike operators are firstly employed to elim- 
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inate the dominated solutions and secondly niching-alike operators are employed 
to eliminate the crowded solutions. But unfortunately, this kind of MOEAs are 
not convergent 14 because of fitness deterioration. The schema of ranking-alike 
and niching-aliice MOEAs(RN_MOEA) could be depicted as Figure H 




Fig. 4. The Ranking-alike and Niching-alike Schema 



Actually, except this schema, there exists another schema. We call it 'the 
sampling schema'. In this schema, the feasible solution space (includes Pareto 
optimal front) is divided into grids in advance, when new solution is generated 
and evaluated, the algorithm firstly computes its coordinate in the grids and 
compare it with the individual(s) in the right coordinate. Whether updating the 
archive with the new solution or not just depends on the comparison. Obvi- 
ously, this kind of methods are very different to ranking-alike and niching-alike 
methods, they use 'local dominance' instead of 'global dominance', and there- 
fore hold lower time complexity. Some of them do not eliminate the dominated 
solutions from the archive in the main loop of algorithm, so additional opera- 
tion(eliminating operator) should be employed after the main loop to cut the 
dominated solutions off from the archive. But if the archive should only store 
nondominated solutions, the eliminating operator should be integrated into the 
main loop. As to the diversity of Pareto optimal front, it depends only on the 
generator, because the span of cells in the grids has been predefined, may adap- 
tively. The schema of sampling MOEAs(SA_MOEA) can be depicted as Figure 

El 



3 Decomposing Existing MOEAs 



In this section, we will use SPEA , AGA and GPS to show how to decompose 
the existing algorithms. 



New Model for MOEA 5 



Offspring 


Archive 


K^Location ) ►C^ Comparison^ *' 

► Flow 
► Information Flow C^T 


/ Replacing \ 

V the archive / 

Storage 
Operator 



Fig. 5. The Sampling Schema 



3.1 SPEA 

As to SPEA, it is a classical RN_MOEA. SPEA's mating selection process is a 
typical selection operator which uses archive and population, clustering method 
actually is an operator to keep diversity,i.e., niching-alike operator. Moreover, 
the truncate and update function can be seen as the strategies to update the 
archive and population. 

3.2 AGA 

Actually, AGA_8 is a typical archiving algorithm. It must combine a generator 
to become MOEAs. AGA employ a nondominated vectors archive, so it employs 
Is_Dominated function and Dominates function to eliminate the dominated 
solutions. Moreover, AGA uses adaptive grids, that is, the boundaries should 
be extended or reduced. However, in spite of these details, AGA samples the 
feasible solution space in essence. Reduce_Crowding function, Steady_State 
function and Fill function actually perform the comparison and replacement. 

3.3 GPS 

GPS is also an archiving algorithm. It employs the Location operator to re- 
trieve the right solutions which will be used to compare with the new solution, 
employs Comparison operator to perform the comparison, and at last employs 
the Steady_State operator to update the archive with the new solution if the 
new solution is better than the original solution in the archive. Moreover, the 
archive of GPS may store the dominated solution, only when the main loop ends, 
an additional operation is used to eliminate the dominated solutions. 

4 Some Important Issues 

According to the model, there are two kinds of archiving algorithms. Based on 
different schema, MOEAs would behave differently, and they would have different 
properties. 
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4.1 Performance Measure 

The convergence property is very important to MOEAs. It would theoretically 
determine the approximation degree to the true Pareto front. But good diversity 
would be very helpful of the decision- maker. That is, MOEAs had better converge 
with diversity. So the performance measure should take both the convergence 
and diversity into considerations. 

AGA has been proved convergent with well-distributed solutions under cer- 
tain strict conditions. GPS also converges to Ray-Pareto optimal front. In con- 
trast to SA_MOEAs, the RN_MOEAs do not converge. Furthermore, the SA_MOEAs 
could be improved to converge to true Pareto front under certain conditions. 

The complexity of MOEAs would be another aspect of performance mea- 
sure. If two multi-objective approaches have different archivers, their average 
performance may difFer[7|. Because of ranking method, the time complexity of 
RN_MOEAs would be greater than or equal to 0{MN) where computing one 
new individual, here M is the number of objectives, N is the size of population(or 
archive). As to AGA and GPS, the time complexity is 0{M). Niching-alike op- 
erators often hold a space complexity of 0{N^). But AGA's is 0{N^'^), GPS's 
is 0{N) at the best situation, 0(A^*^^^) at the worst situation. Furthermore, 
we can reduce GPS's space complexity to 0{N) by using binary tree with an 
additional average time complexity of 0{Nlog2N). 

4.2 Cooperation between Generator and Archive 

In this model, the generator should cooperate with archive to control the evolv- 
ing directions. Therefore, considering to deal with difficult objective functions, 
'local search' may be used to exploit. As to the archive of SA_MOEAs, 'local 
dominance' is useful to reduce the time complexity, 'local search' and 'local 
dominance' are different concepts. 

The evolving directions of the population are multi-objective. In one hand, 
the selection pressure should make the individuals evolving toward the true 
Pareto front, i.e., depth-first search. In the other hand, the selection pressure 
should make the individuals spread over the whole Pareto front, i.e., width-first 
search. How to deal with the conflict between depth-first search and width-first 
search is still lack of delicate research. As to SA_MOEAs, because of local dom- 
inance, the feedback of archive just provide information for depth-first search, 
less for width-first search. 

4.3 TsLxonomy 

Based the proposed model, we suggest that MOEAs could be categorized into 
four classes: 

1. Non-Pareto MOEAs 

The representative MOEA is VEGA pl2| . This algorithm employs multiple 
sub-populations to optimize every single objective separately. This algorithm 
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often converge to special points which often are not Pareto Optimal points, 
moreover, the diversity is not taken into consideration. 

2. Pareto MOEAs (without Elitism) 

The representative MOEAs include Multi-Objective Genetic Algorithm (MOGA) 
[I5] . Niched Pareto Genetic Algorithm (NPGA) |16|17) and Non-dominated 
Sorting Genetic Algorithm (NSGA)[T8]. These algorithms employ some strate- 
gies to maintain the diversity, but approximation is not good enough. 

3. Pareto MOEAs with Elitism 

The representative MOEAs include NSGA-II 4 , Strength Pareto Evolu- 
tionary Algorithm and its iniprovement(SPEA/SPEA2)[5 . These algorithms 
employ elitism strategy to maintain good approximation. But these algo- 
rithms are not convergent. 

4. Convergent MOEAs 

Actually, the archiving algorithms determine the convergence property of 
MOEAs. The representative algorithms include Adaptive Grid Algorithm 
(AGA) [8], GPS 10 11 . These algorithms should converge/pseudoconverge 
under certain conditions. 

5 Conclusions and Future Work 

The proposed model is intended to understand the-state-of-the-art MOEAs and 
provides a more systematic approach to design more efficient and more cus- 
tomized MOEAs for researchers and possible users. 

Our model implies that the ranking-alike and niching-alike schema is very 
different to the sampling schema, though they both may use archive to store 
elitist solutions. 

In contrast to the previous unified models, the new model can describe the- 
state-of-the-art MOEAs more accurately and be more atomic. So it is more 
convenient to use this model for the analysis of the algorithms. 

This model provide us many cues to improve the MOEAs, such as the rela- 
tionship between 'local search' and 'local dominance', the relationship between 
evaluation operation and re-evaluation operator and the relationship between 
depth-first search and width-search etc. The future work would try to discover 
more principles and develop new operators based on this model. 
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